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Abstract — We study the behavior of channel capacity when 
a one-bit quantizer is employed at the output of the discrete- 
time average-power-limited Gaussian channel. We focus on the 
low signal-to-noise ratio regime, where communication at very 
low spectral efficiencies takes place, as in Spread-Spectrum 
and Ultra-Wideband communications. It is well known that, 
in this regime, a symmetric one-bit quantizer reduces capacity 
by 2/ TV, which translates to a power loss of approximately two 
decibels. Here we show that if an asymmetric one-bit quantizer 
is employed, and if asymmetric signal constellations are used, 
then these two decibels can be recovered in full. 

I. Introduction 

We study the effect on channel capacity of quantizing the 
output of the discrete-time average-power-limited Gaussian 
channel using a one-bit quantizer We focus on the low 
signal-to-noise ratio regime, where communication at very low 
spectral efficiencies takes place (as in Spread-Spectrum and 
Ultra- Wideband communications). In this regime, a symmetric 
one-bit quantizer reduces the capacity by a factor of 2 /it, 
corresponding to a 2dB power loss [1]. Hence the rule of 
thumb that "hard decisions cause a 2dB power loss." Here we 
demonstrate that if we allow for asymmetric one-bit quantizers 
with corresponding asymmetric signal constellations, these 
two decibels can be fully recovered. We further demonstrate 
that the capacity per unit-energy can be achieved by a simple 
pulse-position modulation (PPM) scheme. 

The problem of output quantization is relevant for communi- 
cation systems where the receiver uses digital signal process- 
ing techniques, which require the conversion of the analog 
received signal to a digital signal by means of an analog- 
to-digital converter (ADC). For ADCs with high resolution, 
the effects of quantization are negligible. However, using a 
high-resolution ADC may not be practical, especially when 
the bandwidth of the communication system is large and the 
ADC therefore needs to operate at a high sampling rate [2]. 
In this case a low-resolution ADC has to be employed. The 
capacity of the discrete-time Gaussian channel with one-bit 
output quantization indicates what communication rates can 
be achieved when the receiver employs a low-resolution ADC. 

For a symmetric one-bit quantizer (which produces 1 if the 
quantizer input is nonnegative and — 1 otherwise), the capacity 
C'sym(P) under the average-power constraint P on the channel 

The research leading to these results has received funding from the 
European Community's Seventh Framework Programme (FP7/2007-2013) 
under grant agreement No. 252663. 



inputs is given by [1, (3.4.18)], [3, Th. 2] 

Csym(P) =log2-i7b 



(1) 



where log(-) denotes the natural logarithm function; the 
variance of the additive Gaussian noise; 

Hb{p) ^ -plogp- (1 -_p)log(l -p), < p < 1 

(with log = 0) the binary entropy function; and 

Q{x) = -= / exp {-e/2) At X e K 
V 27r Jx 

the Q-function. (Here M denotes the set of real numbers.) This 
capacity can be achieved by transmitting ±-\/P equiprobably. 

From (1), the capacity per unit-energy CsymCO) for a sym- 
metric one-bit quantizer can be computed as [1, (3.4.20)] 



Csym(O) = lim 

^ PiO 



C'sym(P) 



(2) 



This is a factor of smaller than the capacity per-unit energy 
2^ of the Gaussian channel without output quantization [4]. 
Thus, quantizing the channel output by a symmetric one-bit 
quantizer causes a loss of roughly 2dB. 

It is tempting to attribute this loss to the fact that the 
quantizer discards information on the received signal's mag- 
nitude and allows the decoder to perform only hard-decision 
decoding. However, we demonstrate that the loss of 2dB is 
not a consequence of the hard-decision decoder but of the 
suboptimal quantizer In fact, with an asymmetric quantizer 
the loss vanishes. 

The rest of the paper is organized as follows. Section II 
describes the considered channel model, defines the capacity 
per unit-energy, and presents our main result. Section III 
provides the proof of this result. Section IV shows that 
the capacity per unit-energy can be achieved by a simple 
PPM scheme. Section V briefly discusses the capacity of the 
considered channel. And Section VI concludes the paper with 
a summary and discussion of our results. 

II. Channel Model and Capacity Per Unit-Energy 

We consider the discrete-time communication system de- 
picted in Figure 1. It is assumed that the message M is 
uniformly distributed over the set {1,2,..., M}. The encoder 
maps M to the length-n sequence Xi, X2, . . . , X„, which 
is then corrupted by additive Gaussian noise and quantized. 
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Figure 1. System model. 



Thus, at every time instant fc € Z (where 1 denotes the set of 
integers), the received signal Yk corresponding to the channel 
input Xk G M is 



Yk^ Xk + Zk; k 



(3) 



where {Zk, k £ Z,} is a sequence of independent and iden- 
tically distributed (i.i.d.) Gaussian random variables of zero 
mean and variance <j^. The quantizer produces 1 if Yk is in the 
quantization region V and —1 otherwise, for some Borel set 
2? C M. For example, the quantization region of the symmetric 
quantizer is given hy V = {y E R: y > 0}. The decoder 
observes the quantizer's outputs Yi,Y2,...,Yn and tries to 
guess which message was transmitted. 

We assume that the energy in the transmitted sequence does 
not exceed E, i.e., that the encoder is such that, for every 
realization of M, the sequence xi, X2, . . • , x„ satisfies 



E 

fc=i 



xl<L. 



(4) 



We define the capacity per unit-energy along the lines of [5]. 
We say that a rate per unit-energy i?(0) (in nats per energy) 
is achievable if for every e > there exists an encoder, a 
quantizer, and a decoder such that 

log M ■ , ^ 

> i?(0) ~ e 

and such that the probability of error Pr{M ^ M) tends to 
zero as E tends to infinity. The capacity per unit-energy is the 
supremum of all achievable rates per unit-energy. 

It follows from [5, Ths. 2 & 3] that the capacity per unit- 
energy is given by' 



(7(0) = sup = sup 
P>0 P 5#o,-Dci 



p. 



yi|Xi=o) 



e 

where denotes the relative entropy, i.e., 

^(^IIQ) = 



(5) 



loa 



a p<s:Q 

otherwise 



(where P Q indicates that P is absolutely continuous with 
respect to Q); Pyi\Xi=x denotes the output distribution given 
that the input is x; and C(P) is the capacity of the above 
channel under the average-power constraint P on the channel 
inputs, i.e., [6] 



C(P) -sup/(Xi;yi) 



(6) 



with the maximization being over all quantization regions V 
and over all distributions on Xi satisfying E [X^] < P. Note 
that the first supremum in (5) is approached when P tends to 
zero. Thus, the capacity per unit-energy is equal to the slope 
of the capacity-vs-power curve at zero. 

By the Data Processing InequaUty [7, Th. 2.8.1], the capac- 
ity per unit-energy of the above channel is upper-bounded by 
the capacity per unit-energy of the Gaussian channel without 
output quantization, i.e., [4] 



C(0)< 



1 

2^' 



(7) 



In the following, we show that there exists a one-bit quantizer 
that achieves this upper bound. 

Theorem 1 (Main Result): The capacity per unit-energy of 
the discrete-time Gaussian channel with one-bit output quan- 
tization is 

C(0) = ^. (8) 

Moreover, the capacity per unit-energy can be achieved by a 
quantization region of the form 



2? = {y e K: y > T}, for some T e 



(9) 



where T depends on the distribution of the channel input. 

Proof: See Section III. ■ 
We prove Theorem 1 in Section III. A simple PPM scheme 
that achieves the capacity per unit-energy (8) is presented in 
Section IV. 

III. Proof of Theorem 1 

We show that a one-bit quantizer with quantization region T) 
of the form (9) achieves the rate per unit-energy 



^(0) > ^. 



(10) 



Together with (7), this proves Theorem 1. 

To this end, we first note that, for the quantization region 
(9), the conditional probabiUty of the output Yi given the input 



X IS 



P{Yi = l\X^=x) = 



T- 



X e 



(11) 



It is straiglitforward to incorporate the additional maximization over all 
possible quantizers into the proofs of [5, Ths. 2 & 3]. 



Together with (5), this yields 



R{0) = sup ^ 



rQ(i^)iog^ 



+ 



1 - o 



sup < 



loe 



+ 



> ■ (12) 



We choose T = ^ — /x for some fixed /x e M and lower-bound 
the right-hand side (RHS) of (12) by letting tend to infinity. 
This yields for the last two terms on the RHS of (12) 



and 



Hb(Q (-^)) 
lim = 

lim = 0. 



(13) 



(14) 



We use the upper bound on the Q-function [8, Prop. 19.4.2] 



2'Ka 



a > 



(15) 



to lower-bound the first term on the RHS of (12) as 
Q(-^)log^ 



lim 



> 



^(o)>g(-^) 



(16) 



(17) 



e 

Combining (13), (14), and (16) with (12) yields 

from which we obtain (10) by letting jx tend to infinity. This 
proves Theorem 1. 

IV. Pulse-Position Modulation 

The capacity per unit-energy (8) can be achieved 

by the following PPM scheme. For each message 

m e {1,2,...,M}, the encoder produces the sequence 
x\{m),X2{m), . . . ,XM.{'fn)y where 



X'fc(TO) = 



0, 



k — m 
k ^ m 



(18) 



and where ^ satisfies the energy constraint (4) with equality. 
Thus, we have = £^ which for a fixed rate per unit-energy 

R{Q) = 12|M is equal to 



logM 



(19) 



Note that, while the rate per unit-energy is fixed, the rate of 
this scheme is ^°fj^ and tends to zero as M tends to infinity. 
Nevertheless, by (5) the capacity per unit-energy is equal to the 
slope of the capacity-vs-power curve at zero. It thus follows 
from Theorem 1 that there also exists a transmission scheme 
of nonzero rate that achieves (8). 
We employ a quantizer with quantization region 

V = {yeR:y>r} 

i.e., at every time instant k the quantizer produces 1 if Yfe > T 
and —1 otherwise. We choose the threshold T such that the 
probabihty that the quantizer produces —1 given that the 
transmitter sends ^ is equal to some arbitrary < e < 1, 
i.e., 

r = ^-aQ-\e) (20) 



which yields 



P{Yk = -l\Xk = 0=Q 



^- T 



Here ) denotes the inverse Q-function. Note that this 

threshold is of the same form as the threshold we chose in 
Section III to prove Theorem 1. 

The decoder guesses M = m if = 1 and ¥/. = —l for 
k 7^ m. If Yfe = 1 for more than one k, or if Yj^ = — 1 for all 
k = 1, 2, . . . , M, then the decoder declares an error. 

Suppose that message M = m was transmitted. The 
probabihty of an error is given by 



Pr (error | M = m) 



Pr 



1) u (y„ 



-1) 



< ^p(n = i |Xfc = o)+p(n 

= (M - 1) P{Yi = l\Xi=0)+e 



M 



m 



-1 Xr, 



(21) 



where the second step follows from the union bound; the third 
step follows from our choice of T; and the fourth step follows 
because the channel is memoryless which implies that the 
probabihty Pr(yfc = l\Xk = 0) does not depend on k. Since 
the RHS of (21) does not depend on m, it follows that the 
probabihty of error 



1 ^ 

Pr(M ^ M) = — ^ Pr(error | M = m) 

m— 1 

is also upper-bounded by (21). 



The first term on the RHS of (21) can be evaluated as 
(M - 1) P{Yi = 1 I Xi = 0) 



= (M-1)Q ^ (22) 

V <^\lm J 

where the second step follows from (19). We continue by 
showing that if 

i?(0) < 



1 

2^ 



then, for every fixed < e < 1, the RHS of (22) tends to zero 
as M tends to infinity. Indeed, we have 



M 



lim (M - 1) Q 



VloiM-aO-i(e)Vi?(0) 



< 



lim exp (a'^mo) (a + Q-\e))^) Qia) 

a— >oo \ / 



< lim 



^cxp {a + Q-\e)f - 



(23) 



where the first step follows by upper-bounding M — 1 < M 
and by substituting 



v1^-aQ-i(e)Vi?(0) 



i?(0) 



and the second step follows from (15). The hmit on the RHS 
of (23) vanishes for i?(0) < 

Combining (23) with (21), we obtain that if ^(0) < 
then the probability of error tends to e as E — and hence also 
M = exp(E7?(0)) — tends to infinity. Since e is arbitrary, it 
follows that the probability of error can be made arbitrarily 
small by choosing T sufficiently large, thus proving that the 
capacity per unit-energy (8) is achievable by the above PPM 
scheme. 

V. Channel Capacity 

The definition of channel capacity is analog to that of 
capacity per unit-energy. A rate -R(P) is said to be achievable 
if for every e > there exists an encoder, a quantizer, and a 
decoder satisfying 



1 " 



< P, for every realization of M 



fe=i 



such that 



logM 



n 



> i?(P) - e 



and such that the probability of error Pr(M 7^ Af) tends to 
zero as n tends to infinity. The capacity C(P) is the supremum 
of all achievable rates. For the above channel, the capacity is 
given by [6] 

C(P) = sup/(Xi;yi) (24) 



where the supremum is over all quantization regions P C M 
and over all distributions on Xi satisfying E [X^] < P. 

If we do not maximize over the quantization region but 
assume a symmetric quantizer, i.e., V = {y E R: y > 0}, 
then the capacity is given by [1, (3.4.18)1, |3, Th. 2] 

aym(P) = log 2 - Hi (q (yP0) ) (25) 

where Hh{-) denotes the binary entropy function and Q{-) 
denotes the Q-function, see Section 1. In this case the capacity- 
achieving input distribution is binary with equiprobable mass 
points at \f? and — \/P. 

To the best of our knowledge, the capacity of the above 
channel (maximized over the input distribution and the quan- 
tization region) as well as the capacity-achieving input distri- 
bution and the optimal quantization region are unknown. The 
following two propositions present results on the latter two 
problems. 

Proposition 2: The capacity-achieving input distribution is 
discrete with at most three mass points S R, I = 1,2,3 
satisfying 



X^P^C^ = and ^peS.e = P 



(26) 



where pi denotes the probability corresponding to mass point 
^i, i.e., 0<pf<l,£ = 1,2,3 and pi -Fp2 +P3 = 1- 

Proof: Omitted. ■ 
This result is consistent with [3, Th. 1], which shows that if 
the quantization regions of a K-bit quantizer partition the real 
line into 2^ intervals, then a discrete input distribution with 
not more that 2'^ + 1 mass points achieves the capacity. 

Proposition 3: A threshold quantizer is optimal, i.e., the 
capacity- achieving quantizer is of the form 

V = {y eR: y >T}, for some T e M (27) 

where T is determined by P and a^. 

Proof: Omitted. ■ 
Propositions 2 and 3 demonstrate that the capacity of the 
above channel is equal to the capacity of a discrete memory- 
less channel with input alphabet {Ci,C2,C3}> output alphabet 
{1, —1}, and channel law 



Pr(F = 1 I X = ^e) = Q 



e= 1,2,3. (28) 



It can be further shown that the supremum on the RHS of (24) 
is achieved, so 



TeR 



(29) 



where /(p, W) denotes the mutual information of a channel 
with channel law W when the channel input is distributed 
according to p; V{P) denotes the set of probability vectors 
p G [0, 1]'^ and mass points ^ G satisfying 
33 3 
^p^ = l, ^p^e^=0, and J2p^& = 'P' (30) 



and W{T,^) denotes the channel law given by (28). Thus, 
instead of maximizing the mutual information over all Borel 
sets V and all probability distributions on Xi satisfying 
E [X^] < P (24), it suffices to maximize the mutual infor- 
mation over the four real numbers ^i, ^2, £,3, and T and the 
three-dimensional probabiUty vector p satisfying (30). 

VI. Summary and Conclusion 
It is well-known that quantizing the output of the discrete- 
time average-power-limited Gaussian channel using a sym- 
metric one-bit quantizer reduces the capacity per unit-energy 
by a factor of 2/7r. We have shown that this loss can be 
fully recovered by allowing for asymmetric one-bit quantiz- 
ers with corresponding asymmetric signal constellations. We 
have further shown that the capacity per unit-energy can be 
achieved by a simple PPM scheme. For this scheme, the error 
probability can be analyzed directly using the union bound 
and the upper bound (15) on the Q-function. We thus need not 
resort to conventional methods used to prove coding theorems, 
such as the method of types, information-spectrum methods, 
or random coding exponents. 

The above results demonstrate that the 2dB power loss in- 
curred on the Gaussian channel with symmetric one-bit output 
quantization is not due to the hard-decision decoder, but due to 
the synometric quantizer. In fact, if we employ an asymmetric 
quantizer, and if we use asymmetric signal constellations, then 
hard-decision decoding achieves the capacity per unit-energy 
of the Gaussian channel. 



The above results also demonstrate that a threshold quan- 
tizer is asymptotically optimal as the signal-to-noise ratio 
tends to zero. We have further shown that this is true not 
only asymptotically: for a fixed signal-to-noise ratio, we have 
shown that, among all one-bit output quantizers, a threshold 
quantizer is optimal. 
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